Optimal Control Strategy Research Articles

Study on SEAI Model of COVID-19 Based on Asymptomatic Infection

In this paper, an SEAI epidemic model with asymptomatic infection is studied under the background of mass transmission of COVID-19. First, we use the next-generation matrix method to obtain the basic reproductive number R0 and calculate the equilibrium point. Secondly, when R0<1, the local asymptotic stability of the disease-free equilibrium is proved by Hurwitz criterion, and the global asymptotic stability of the disease-free equilibrium is proved by constructing the Lyapunov function. When R0>1, the system has a unique endemic equilibrium point and is locally asymptotically stable, and it is also proved that the system is uniformly persistent. Then, the application of optimal control theory is carried out, and the expression of the optimal control solution is obtained. Finally, in order to verify the correctness of the theory, the stability of the equilibrium point is numerically simulated and the sensitivity of the parameters of R0 is analyzed. We also simulated the comparison of the number of asymptomatic infected people and symptomatic infected people before and after adopting the optimal control strategy. This shows that the infection of asymptomatic people cannot be underestimated in the spread of COVID-19 virus, and an isolation strategy should be adopted to control the spread speed of the disease.

Optimal control analysis of COVID-19 stochastic model with comprehensive strategies

In this paper, we construct a stochastic SVEAIR (Susceptible-Vaccinated-Exposed -Asymptomatic-Infected-Removed) epidemic model. It aimed to investigate COVID-19 control strategies through four different control methods, which consist of prophylaxis, vaccination control, rapid screening of people in exposure categories, and people identified as infected without screening. Firstly, we study the optimal control model and obtain the optimal control strategy using stochastic control theory. Secondly, the optimal control model with control term or without control term is numerically analyzed by using the implicit Runge-Kutta approximation method. At last, The numerical simulations verify the theoretical results and it show that control could help reduce infection and improve population health.

Cooperative lane-changing for connected autonomous vehicles merging into dedicated lanes in mixed traffic flow

Connected and automated vehicles (CAVs) have enormous potential to enhance traffic safety, efficiency, and emissions reduction. However, in the initial phases of CAV development, mixed traffic comprising CAVs and human-driven vehicles (HDVs) will inevitably coexist in the traffic system. To fully exploit the benefits of CAVs, dedicated lanes with independent rights of way will be established. This paper proposes an optimal control strategy for coordinating the mandatory lane-changing of CAVs from ordinary lanes to dedicated lanes. The strategy develops a centralized two-stage cooperative optimal control model to optimize the lane-changing sequence and trajectories of CAVs. In the first stage, a dynamic programming formulation is designed to determine the lane-changing sequence decisions. The model predictive control (MPC) controller is adopted to dynamically solve the optimal control problem with a fixed terminal state. In the second stage, we dynamically and cooperatively designed the longitudinal trajectories of related CAVs. The lateral trajectories of lane-changing CAVs are planned with a cubic polynomial. The objective function considers driving comfort and state tracking to ensure traffic smoothness. Simulation results show that: (1) the proposed strategy can improve the negative impact of lane-changing behavior under different traffic demand levels. (2) Compared to the benchmark approach, the proposed strategy can significantly enhance traffic efficiency and driving comfort, particularly in medium-traffic demand. The strategy can improve the average speed of CAVs by approximately 12 % and decrease the average acceleration by over 45 %. (3) The average fuel consumption is positively correlated with traffic demands and the difference in arrival speeds between lane-changing and dedicated lane CAVs. (4) The effectiveness of the strategy increases with the length of the lane-changing segment. However, the marginal benefit becomes negligible when the segment exceeds 300 m. Therefore, the findings of this paper can provide theoretical support for the cooperative control of CAVs in dedicated lanes of highways in the future.

Adaptive state-of-health temperature sensitivity characteristics for durability improvement of PEM fuel cells

To obtain the temperature sensitivity characteristics of the proton exchange membrane fuel cell under different degradation levels, accelerated durability tests and temperature sensitivity tests of the fuel cell are first performed, and the temperature characteristics under different degradation states are analyzed by electrochemical impedance spectroscopy and polarization curve. Besides, an adaptive state-of-health transient thermal model of fuel cells is developed to investigate the effect of operating temperature on the internal gas concentration and hydrothermal distribution characteristics of the fuel cell from a mechanistic perspective. The experimental results of temperature sensitivity validate that the adaptive state-of-health transient thermal model can effectively monitor the steady and transient performance of the fuel cell. Subsequently, a mathematical model is proposed to describe the relationship among the load current, state of health, and optimal temperature using the temperature sensitivity test data and the transient thermal model of the adaptive state of health, which provides important insights into the optimal temperature range tailored to the current state of health of fuel cells to ensure efficient and stable operation of fuel cells all the time and contributes to the fine design of an optimal degradation adaptive temperature control strategy.

A chaos game optimization algorithm-based optimal control strategy for performance enhancement of offshore wind farms

This paper presents a novel application of the chaos game optimization (CGO) algorithm to optimally design PI controllers for power electronic interface circuits of offshore wind farms (OWF) consisting of a permanent magnet synchronous generator powered by a variable-speed wind turbine. The OWF is linked to the network via a high-voltage direct current (HVDC) transmission system. The CGO metaheuristic method is employed to fine-tune voltage source converter (VSC)-based HVDC transmission systems’ proportional-integral controller gains. The study explores multiple strategies to extract the highest power from the system while ensuring stability under symmetrical and unsymmetrical fault conditions. The CGO algorithm consistently yields superior results to other algorithms, improving system regaining and stability post disturbances. Consequently, the technique enhances the dynamic and transient stability of the OWF. The detailed study is implemented using MATLAB/Simulink.

Band gap study of periodic piezoelectric micro-composite laminated plates by finite element method and its application in feedback control

Phononic crystals are materials or structures with periodic variations of elastic constants and density. Elastic waves in phononic crystals cannot propagate within a certain frequency range, called the band gap, due to the interference of their internal structure. This article investigates how fiber orientation affects the band gap properties of periodic micro-composite laminated plates. We examined the impact of five common composite laminate configurations on the system’s band gap and discovered that the antisymmetric configuration had superior high-frequency band gap performance. Based on this finding, we further explored how the antisymmetric angle influenced the system’s band gap. Since the study was conducted at a micro scale, micro structural effects were considered. Therefore, we used the modified coupled stress elastic dynamics and a four-node quadrilateral non-conforming element to discretize the micro composite laminated plate model, which had the nodal compatibility of high-order elasticity theory. Moreover, we employed feedback control to the proposed structure to dynamically adjust the band gap width according to different practical needs. This research supports the design of periodic micro-composite laminated plates and the piezoelectric feedback control system, which can control the vibration and wave propagation behaviors of micro structures using coupled piezoelectric sensors and actuators. The piezoelectric feedback control employed two control methods: direct proportional control and acceleration control. This article compared the single and multiple control methods of these two approaches to determine the optimal control strategy.

Reliability control of nonlinear stochastic dynamical system based on discrete data

Stochastic optimal control based on reliability plays a crucial role in mitigating structural failure and ensuring safe operation. For general stochastic vibration systems, a data-driven method for reliability-based optimal control is proposed based on random state data. Firstly, the feedback control is split into conservative and dissipative components in coherence with physical intuition, and each component is expanded upon using pre-selected basic functions, resulting in a modified system with undetermined coefficients. Then, from discrete random samples, the expressions for the probability densities of the first-passage time and the stationary response can be identified, explicitly including system and excitation parameters, as well as initial and safety boundary conditions. Finally, a performance index, combining system reliability and control cost, is constructed and can be explicitly expressed in terms of the undetermined coefficients of the control forces. The optimal control problem for determining the optimal control forces is reformulated as an optimization problem for determining the coefficients that minimize the performance index. This unconstrained optimization problem can be easily solved. Three typical nonlinear stochastic systems, a controlled Duffing oscillator, a controlled nonlinear hysteretic system, and a controlled 2-DOF nonlinear dynamical system, are given to illustrate the validity and accuracy of the proposed data-driven method. Additionally, the control performance of the optimal control strategy in improving the system reliability is also discussed.

Vibration Control with Reinforcement Learning Based on Multi-Reward Lightweight Networks

This paper proposes a reinforcement learning method using a deep residual shrinkage network based on multi-reward priority experience playback for high-frequency and high-dimensional continuous vibration control. Firstly, we keep the underlying equipment unchanged and construct a vibration system simulator using FIR filters to ensure the complete fidelity of the physical model. Then, by interacting with the simulator using our proposed algorithm, we identify the optimal control strategy, which is directly applied to real-world scenarios in the form of a neural network. A multi-reward mechanism is proposed to assist the lightweight network to find a near-optimal control strategy, and a priority experience playback mechanism is used to prioritize the data to accelerate the convergence speed of the neural network and improve the data utilization efficiency. At the same time, the deep residual shrinkage network is introduced to realize adaptive denoising and lightweightness of the neural network. The experimental results indicate that under narrowband white-noise excitation ranging from 0 to 100 Hz, the DDPG algorithm achieved a vibration reduction effect of 12.728 dB, while our algorithm achieved a vibration reduction effect of 20.240 dB. Meanwhile, the network parameters were reduced by more than 7.5 times.

Seamless Switching Control Strategy for a Power Conversion System in a Microgrid Based on Extended State Observer and Super-Twisting Algorithm

Microgrids can operate stably in both islanded and grid-connected modes, and the transition between these modes enhances system reliability and flexibility, enabling microgrids to adapt to diverse operational requirements and environmental conditions. The switching process, however, may introduce transient voltage and frequency fluctuations, causing voltage and current shocks to the grid and potentially damaging devices and systems connected to the microgrid. To address this issue, this study introduces a novel approach based on the Extended State Observer (ESO) and the Super-Twisting Algorithm (STA). Power conversion systems use Virtual Synchronous Generator (VSG) control and Power-Quality (PQ) control when they are connected to the grid or when the microgrid is not connected to the grid. VSG and PQ share a current loop. Transitioning the reference current generated by the outer loop achieves the switching of control strategies. A real-time observer is designed to estimate and compensate for current fluctuations, disturbances, and variations in id, iq, and system parameters during the switching process to facilitate a smooth transition of control strategies. Furthermore, to enhance the dynamic response and robustness of the system, the Proportional–Integral (PI) controller in the ESO is replaced with a novel super-twisting sliding mode controller based on a boundary layer. The Lyapunov stability principle is applied to ensure asymptotic stability under disturbances. The proposed control strategy is validated through simulation using a seamless switching model of the power conversion system developed on the Matlab/Simulink (R2021b) platform. Simulation results demonstrate that the optimized control strategy enables smooth microgrid transitions, thereby improving the overall reliability of grid operations.

USV Trajectory Tracking Control Based on Receding Horizon Reinforcement Learning.

We present a novel approach for achieving high-precision trajectory tracking control in an unmanned surface vehicle (USV) through utilization of receding horizon reinforcement learning (RHRL). The control architecture for the USV involves a composite of feedforward and feedback components. The feedforward control component is derived directly from the curvature of the reference path and the dynamic model. Feedback control is acquired through application of the RHRL algorithm, effectively addressing the problem of achieving optimal tracking control. The methodology introduced in this paper synergizes with the rolling time domain optimization mechanism, converting the perpetual time domain optimal control predicament into a succession of finite time domain control problems amenable to resolution. In contrast to Lyapunov model predictive control (LMPC) and sliding mode control (SMC), our proposed method employs the RHRL controller, which yields an explicit state feedback control law. This characteristic endows the controller with the dual capabilities of direct offline and online learning deployment. Within each prediction time domain, we employ a time-independent executive-evaluator network structure to glean insights into the optimal value function and control strategy. Furthermore, we substantiate the convergence of the RHRL algorithm in each prediction time domain through rigorous theoretical proof, with concurrent analysis to verify the stability of the closed-loop system. To conclude, USV trajectory control tests are carried out within a simulated environment.

Methodology to minimize the dynamic response of tall buildings under wind load controlled through semi-active magneto-rheological dampers

This paper proposes a methodology to evaluate and optimize the dynamic response of tall buildings under wind loading, controlled through semi-active Magneto-Rheological dampers (MR dampers). For this, a tall building, modeled as a 2D frame, is taken as case study and three structural control configurations are proposed. The original structural configuration of the building is the first configuration analyzed, called Uncontrolled Original (C1). In the second configuration, called Uncontrolled Optimized (C2), the fundamental frequency of the building is optimized via PSO algorithm as a function of its mass. Then, in the third configuration, Controlled Optimized (C3), a set of MR dampers with behavior formulated via the modified Bouc-Wen rheological model and controlled through the Linear Quadratic Regulator associated with the Clipped Optimal control strategy (LQR-CO) is applied to the structure. Finally, the dynamic response of the three scenarios under wind action is analyzed and compared to performance criteria established in the literature. The results demonstrate that the C3 configuration is the only one able of satisfying all the established performance criteria, proving that the proposed methodology y that combines structural optimization with MR dampers is a powerful tool for vibration control.

Adaptive Reactive Power Optimization in Offshore Wind Farms Based on an Improved Particle Swarm Algorithm

To address the reactive power optimization control problem in offshore wind farms (OWFs), this paper proposes an adaptive reactive power optimization control strategy based on an improved Particle Swarm Optimization (PSO) algorithm. Firstly, an OWF multi-objective optimization control model is established, with the total sum of voltage deviations at wind turbine (WT) terminals, active power network losses, and reactive power margin of WTs as comprehensive optimization objectives. Innovatively, adaptive weighting coefficients are introduced for the three sub-objectives, enabling the weights of each optimization objective to be adaptively adjusted based on real-time operating conditions, thus enhancing the adaptability of the reactive power optimization model to changes in operating conditions. Secondly, a Uniform Adaptive Particle Swarm Optimization (UAPSO) algorithm is proposed. On one hand, the algorithm initializes the particle swarm using a uniform initialization method; on the other hand, it improves the particle velocity update formula, allowing the inertia coefficient to adaptively adjust based on the number of iterations and the fitness ranking of particles. Simulation results demonstrate the following: (1) Under various operating conditions, the proposed adaptive multi-objective reactive power optimization strategy can ensure the stability of node voltages in offshore wind farms, reduce active power losses, and simultaneously improve reactive power margins. (2) Compared with the traditional PSO algorithm, UAPSO exhibits an approximately 10% improvement in solution speed and enhanced solution accuracy.

Experimental evaluation of accuracy and efficiency of two control strategies for a novel foot commanded robotic laparoscope holders with surgeons

The implementation of a laparoscope-holding robot in minimally invasive surgery enhances the efficiency and safety of the operation. However, the extra robot control task can increase the cognitive load on surgeons. A suitable interface may simplify the control task and reduce the surgeon load. Foot interfaces are commonly used for commanding laparoscope-holding robots, with two control strategies available: decoupled control permits only one Cartesian axis actuation, known as decoupled commands; hybrid control allows for both decoupled commands and multiple axes actuation, known as coupled commands. This paper aims to determine the optimal control strategy for foot interfaces by investigating two common assumptions in the literature: (1) Decoupled control is believed to result in better predictability of the final laparoscopic view orientation, and (2) Hybrid control has the efficiency advantage in laparoscope control. Our user study with 11 experienced and trainee surgeons shows that decoupled control has better predictability than hybrid control, while both approaches are equally efficient. In addition, using two surgery-like tasks in a simulator, users’ choice of decoupled and coupled commands is analysed based on their level of surgical experience and the nature of the movement. Results show that trainee surgeons tend to issue more commands than the more experienced participants. Single decoupled commands were frequently used in small view adjustments, while a mixture of coupled and decoupled commands was preferred in larger view adjustments. A guideline for foot interface control strategy selection is provided.

A mathematical analysis of the corruption dynamics model with optimal control strategy

Corruption is a global problem that affects many countries by destroying economic, social, and political development. Therefore, we have formulated and analyzed a mathematical model to understand better control measures that reduce corruption transmission with optimal control strategies. To verify the validity of this model, we examined a model analysis showing that the solution of the model is positive and bounded. The basic reproduction number R0 was computed by using the next-generation matrix. The formulated model was studied analytically and numerically in the context of corruption dynamics. The stability analysis of the formulated model showed that the corruption-free equilibrium is locally and globally asymptotically stable for R0 < 1, but the corruption-endemic equilibrium is globally asymptotically stable for R0 > 1. Furthermore, the optimal control strategy was expressed through the Pontryagin Maximum Principle by incorporating two control variables. Finally, numerical simulations for the optimal control model were performed using the Runge-Kutta fourth order forward and backward methods. This study showed that applying both mass education and law enforcement is the most efficient strategy to reduce the spread of corruption.

Study on Dynamic Response Characteristics of Offshore Floating Wind Turbine Pitch System

Due to its special working conditions, offshore wind turbine will bear large direct and indirect loads under the combined action of air flow and wave flow. In this paper, a variable pitch system composed of variablepitch motorand variable pitch bearing is improved, and the characteristics of system's bending moment, torque, vibration and other physical quantities under the action of multiple physical loads are verified, and the mechanical response characteristics of floating wind turbine under the control of unified variable pitch and independent variable pitch are studied under the running conditions at sea. The results show that mechanical structure of uniform pitch is compared with that of independent pitch, the independent variable pitch structure can effectively reduce the mean oscillation value of wind turbine tower in the parallel direction of air flow by optimizing control strategy, and reduce the thrust at the hub of wind turbine and the bending moment at the root of tower, but increase the vibration frequency and fatigue load of offshore wind turbine tower along parallel direction of air flow. Reduce the fatigue life of equipment. The research results can be used as a reference to reduce the variable pitch control and vibration suppression of offshore wind turbines and improve the reliability of wind turbines.

Differential graphical game‐based multi‐agent tracking control using integral reinforcement learning

AbstractThis paper studies the cooperative tracking control problem of interacted multi‐agent systems (MASs) under undirected communication. Based on differential graphical game theory, the MAS tracking control problem is formulated as an infinite horizon cooperative differential graphical game‐theoretic tracking control framework, where a multi‐objective optimization problem is designed and then cast into a Pareto‐equivalent single‐objective optimization problem using a scalarization method. Necessary and sufficient conditions for the existence of the Pareto‐optimal strategy to the game theoretic tracking control are established, where it has been proven that the solution to the integral Bellman optimality equation leads to Pareto‐optimal strategy. Then, an off‐policy integral reinforcement learning scheme to find optimal control strategy using a pure data‐driven manner is developed, which consumes less computation efforts than the traditional learning scheme. Simulated results are conducted to validate the effectiveness of the proposed game and IRL‐based tracking control method.

Research on Energy Consumption Optimization Control Strategy of Electric Vehicle Electric Drive Oil/Water Cooling System

Research on Energy Consumption Optimization Control Strategy of Electric Vehicle Electric Drive Oil/Water Cooling System

An Optimized Grid‐Forming Control Strategy for the Flexible Interconnection System in Distribution Transformer Areas

The flexible interconnection system (FIS) in distribution transformer areas can improve the local consumption capacity of high penetration rate distributed photovoltaics and solve the problem of the high loading rate of distribution transformers. This paper presents an optimized grid‐forming control strategy for the FIS in distribution transformer areas. First, the DC side impedance small signal model of the FIS is built, and the reason for the stability difference of the FIS is analyzed when the active power flows in different directions. An optimized control structure is then presented based on the conventional grid‐forming control strategy. The theoretical analysis shows that the optimized grid‐forming control strategy can improve the stability of the FIS. Finally, the controller hardware‐in‐the‐loop experiments based on RT‐LAB confirm the effectiveness of the presented optimized control strategy. © 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC.

Minimum decision of collision injury based on drivable area in unavoidable scene

The existing technology for assisted driving collision avoidance has improved the active safety of vehicles, but it is primarily designed for scenarios where collisions can be avoided. It is not suitable for situations where pedestrians suddenly intrude. Therefore, there is a need to develop a control strategy that can minimize collision injuries in unavoidable situations. This study focuses on typical collision scenarios where pedestrians suddenly intrude. It proposes a real-time online double-layer optimal pre-collision control strategy based on drivable area, using the Head Injury Criteria ( HIC) as a quantifiable measure of collision injury. The upper-layer controller designs a cost function based on a three Degrees of Freedom (DOF) collision solving model to minimize collision injuries. It takes the constraints of vehicle dynamics, maximum front wheel steering angle, pedestrian avoidance into account, and the optimal pre-impact state point with the minimum HIC value is calculated in real-time. Meanwhile, the lower-layer controller is designed to track the optimal pre-impact state point using Model Predict Control (MPC) algorithm. The effectiveness of the proposed control strategy is verified through Simulink simulation, achieving the dual objectives of avoiding pedestrians suddenly intruding and minimizing passenger collision injuries.

Adaptive fault-tolerant optimal control for hypersonic vehicles with state constrains based on adaptive dynamic programming

This paper addresses a novel adaptive fault-tolerant control (FTC) design based on adaptive dynamic programming (ADP) technique for hypersonic vehicle (HSV) subject to actuator fault and state constrains. The total control input is constructed by the combination of backstepping-based adaptive FTC and the ADP-based adaptive optimal control to improve the tracking performance and fault-tolerant capacity. By introducing a barrier Lyapunov function (BLF) to deal with the state constraints, a backstepping-based FTC scheme is designed to transform the tracking control problem into an equivalent optimal control problem. Subsequently, an adaptive optimal control strategy is developed by using the ADP technique to provide a supplementary control action. A critic network is constructed to solve the Hamilton–Jacobi-Bellman (HJB) equation online. The convergence properties of the closed-loop system are developed by utilising the Lyapunov stability theory. Finally, simulation results are carried out to illustrate the effectiveness and efficiency of the proposed adaptive ADP-based FTC strategy.